APPROXIMATION AND BILLIARDS 

SERGE TROUBETZKOY 



Abstract. This survey is based on a series of talks I gave at the 
conference "Dynamical systems and Diophantine approximation" 
at I'Instut Henri Poincare in June 2003. I will present asymptotic 
results (transitivity, ergodicity, weak-mixing) for billiards based on 
the approximation technique developed by Katok and Zemlyakov. 
I will also present approximation techniques which allow to prove 
the abundance of periodic trajectories in certain irrational poly- 
gons. 



1. Introduction. 

The use of approximation techniques in dynamical systems was appar- 
ently started in 1941 by Oxtoby and Ulam |OxUlj who proved that for a 
finite-dimensional compact manifold with a non-atomic measure which 
is positive on open sets the set of ergodic measure-preserving homeo- 
morphisms is generic in the strong topology. In 1967 Katok and Stepin 
[KaStj proved the genericity of of ergodicity and weak-mixing for cer- 
tain classes of interval exchange transformations. The approximation 
method was first applied to polygonal billiard by Katok and Zemlyakov 
who, using the fact that for rational polygons the directional billiard 
is minimal in almost all directions, proved that the typical irrational 
billiard is topological transitive (i.e. has dense orbits) |KaZej . 

In this survey we will first reprove the Katok Zemlyakov result and then 
give further developments based on this idea. Then we will discuss 
another approximation result, based on inhomogeneous diophantine 
approximation, to conclude that there are many periodic billiard orbits 
in irrational parallelograms and related polygons. 



2. Background. 

In this section we give the necessary background on billiards, more 
details can be found in the surveys |Taj . [MaTi^ . The billiard flow in 
a domain P C is defined as follows: a point mass moves freely 
inside P and when it reaches the boundary it is reflected following the 
usual law of geometric optics, the angle of incidence equals the angle 
of reflection. The first return map to the boundary of P is called the 
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Figure 1. Invariant surfaces. 

billiard map. The billiard map preserves a natural measure sin 9 ds dO 
where s is the arc length parameter on dP and G S"*" is the angle 
between the direction of the billiard motion and the direction of the 
boundary. 

A polygon is called rational is all the angles between sides are rational 
multiples of tt. For rational polygons there is a well known construc- 
tion of invariant billiard surfaces. Suppose the angles are of the form 
miTr/ui. Consider the group G{P) generated by the reflections in the 
sides of P and let 0{P) C S"*^ be the linearization of G{P). The group 
0{P) is simply the dihedral group generated by the reflections in 
hnes through the origin that meet at angles n/N. Here N is the least 
common multiple of the n'^s. 

Consider the phase space of the billiard flow P x S^, and let Rg be 

its subset of points whose second coordinate belongs to the orbit of 6 
under Djv- Since every trajectory changes directions at reflections by 
elements oi Dj^ we have that Rq is an invariant set. In fact it is a flat 
surface (possibly) with conical singularities. 

To construct Rq (for d ^ kn/N) consider 2N disjoint parallel copies 
Pi, P2,..., P2N of P. Consider the 0{P) orbits {^1, 62,..., 92n} of 9. 
Consider a pair {Pi, 9i). Fix a side of Pi and reflect 9i in this side, this 
yields a 9j. Paste the given side of Pi and Pj. Doing this for each i 
yields the surface. For example the billiard in the square has a torus 
as invariant surface while the invariant surface for the billiard in the in 
the right triangle with angle 7r/8 is of genus two (see Figure 1). 

3. Old approximation results for polygons. 

It is not very difficult to prove that the billiard flow/map restricted to 
Re is minimal for all but countably many 9. We are now ready to state 
and prove Katok-Zemlyakov's result. Consider the space X of simply 
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connected n-gons. Note that this space is not compact since n-gons 
can degenerate into n' gons with n' < n. Thus we say that a property 
is typical if for any compact set i^T C X the property holds for a dense 
Gs subset of 

Theorem 3.1. jKaZej The billiard in a typical polygon is topologically 
transitive. 

Proof. Let D C be the disc. Identify the phase space of the bilhard 
flow in each n-gon with P x S"*" and assume that this identification 
depends continuously on the polygon. Let Bi be a countable basis for 
the topology of P x S"*". 

Fix an nonempty open set ?7a; C x S"*" (the choice of this set will 
be made precise below) and let d K he the set of ra-gons P such 
that there exists a billiard trajectory starting in Uk that visits all (the 
images of) the sets . . . , 5^ in the phase space of the billiard flow in 
P. Each Kk is open, and their intersection is a set. 

To see denseness let Yq be the set of rational ra-gons with angles Tcpi/qi, 
with Pi, Qi co-prime and the least common multiple of the at least q. 
For every P eY^ each invariant surface Mq is 1/g dense in the phase 
space. Therefore for every k there exists q such that for every P E Yq 
the surface Mg (for all 9) intersects Uk and all the (images of) the sets 
Bi, . . . , Bk in the phase space of the billiard flow in P. Since Mg has a 
dense trajectory for all but countably many 6 we have Yg C Xk- Thus 
since Yg is dense in the space of n-gons, the set Kk is as well. It follows 
that r\Kk is dense. 

Let P be a polygon in (iKk- The choice of t/i is arbitrary. Let 
Ui C t^i be a nonempty compact neighborhood. Suppose we have 
inductively chosen a nonempty compact neighborhood Uk-i C Uk-i- 
Let Uk C Uk^i be open. Since P G Kk we can find a billiard trajectory 
starting in Uk that visits each Bi, . . . ,Bk. By continuity there is an 
compact neighborhood Uk C Uk-i such that each trajectory in Uk visits 
Bi, . . . ,Bk within a bounded time T^. Thus any x G HUk = nUk has a 
dense trajectory, possibly singular!! 

To see that there are non-singular trajectories it suffices to produce 
an uncountable collection of such dense trajectories. Since there are 
only countably many saddle connections, i.e. orbits segments starting 
and ending at a vertex, most of the dense trajectories are not saddle 
connections. If such a trajectory is singular, i.e. the nth iterate arrives 
at a vertex, then the (forward) orbit starting at time n -|- 1 is dense and 
non- singular. 



This detail is often overlooked in the literature. 
'This detail is also often overlooked in the literature. 
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Thus we modify the construction to produce a Cantor set (an uncount- 
able set) of points with dense trajectories. To do this choose Ifk be the 
disjoint union of 2^ nonempty compact neighborhoods such that each 
neighborhood contains exactly two of the neighborhoods of Uk+i and 
such that there is a billiard trajectory in each of the neighborhoods 
which visits the sets Bi, . . . , B^. □ 

In 1986, Kerckhoff, Masur and Smillie, using Teichmiiller theory, proved 
that the directional billiard flow is uniquely ergodic for almost every 
direction [KeMaSm] . The surfaces Mg are not only 1/q dense in the 
phase space, but also approximately well distributed. Combining these 
two facts and no other new ideas one can conclude: 

Theorem 3.2. [KeMaSml IKal IPoSt] The billiard in a typical polygon 
is ergodic. 

Let : N ^ such that lim^^oo 4>{(l) = 0. Let P be a n-gon with 
angles ai, . . . , a„. We say that P admits approximation by rational 
polygons at rate if for every go > there is g > go and positive 
integers pi, . . . each co-prime with g such that \ai — TTPi/q\ < 0(g) 
for all i. 

Vorobets has proven the following constructive ergodicity result: 

Theorem 3.3. |Voj Let P be a polygon that admits approximation by 
rational polygons at the rate 



then the billiard flow in P is ergodic. 
I proved the following theorem: 

Theorem 3.4. [Tr2j The billiard map in a typical polygon is totally 
ergodic, i.e. is ergodic for all n G N. 

Both the constructive ergodicity and the total ergodicity theorems are 
proven by using an alternative version of the proof of the result of 
Kerckhoff, Masur and Smillie based on a combination of ideas of Masur 
and Boshernitzan |Ma[ IBo2j . 

In 1999 I applied the approximation method to infinite polygons |Trl] . 
My result was improved by Degli Esposti, Del Magno and Lenci who 
showed: 

Theorem 3.5. |DeDeLe] Suppose pn is a monotonically decreasing se- 
quence of positive numbers satisfying = 1. Let 

P = Un>o[n,n + l] X [0,pn]. 
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Then the billiard in a typical P is ergodic for a.e. direction. 

Here the topology on the space of such P is given by the metric 
d(P, Q) := J2 \Pn - qn\ = Area{PAQ). 

To prove this result approximate P by finite polygons from the class, 
i.e. g„ = 0, for n > N. 

4. Old approximation results for convex smooth tables. 

Let C be a strictly convex billiard table. A compact convex set K is 
a caustic of C if the boundary of C is obtained by wrapping a string 
around K, pulling it tight at a point and moving the point around K 
while keeping the string tight. If a billiard orbit is tangent to a caustic 
once, then it is tangent to it in-between every pair of bounces. 

In 1979 Lazutkin showed: 

Theorem 4.1. |Laj IfC is a sufficiently smooth strictly convex billiard 
table then the table contains "many" caustics. 

Many means the union of the caustics has positive area. 

Corollary 4.2. The billiard in a sufficiently smooth strictly convex 
table is not ergodic, not even topologically transitive. 

The proof of Lazutkin's result is based on KAM theory. Lazutkin's 
original proof need the table to be C^^^. Riissmann's version of KAM 
can be used to replace 553 by 8, and finally R. Douady's version of 
KAM shows that 7 is sufficient [Riit IDo] . 

In 1990 Gruber noticed that we can apply the approximation ideas of 
the previous section to prove contrasting results for the low smoothness 
case. 

Theorem 4.3. [GrJ The C^-typical convex billiard table has the fol- 
lowing properties: 

a) it contains no caustics, 

b) it is strictly convex, 

c) it is of class , 

d) it is topologically transitive. 

To prove the topological transitivity we approximate a convex table by 
finite polygons with increasing number of sides. 

In fact, using approximation teachings and the results of Kerckhoff, 
Masur and Smillie one can easily conclude that 
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Theorem 4.4. C^-typical C^-convex billiard table is strictly convex 
and ergodic. 

5. New results on smooth tables. 

With A. Stepin we have have improved Gruber's result. To describe 
our result we begin by a new characterization of weak mixing. 

5.1. Weak mixing. Let {X, (3, fi) be a probability space and T : X — >■ 
X a measure preserving transformation. T is weak mixing iff 

^ n — 1 

\fA,Bef3: lim - y |/i(T-^A n B) - n{A)^i{B) \ = 

n—*oo n ^ 
A:=0 

iff VA, B ep-. there exists J = J{A, 5) C N of full density (i.e. (#n G 
J : n < A^)/A^ 1) such that 

lim ij{T-^A r]B)= 

nG J— >oo 

A set J C N is called full if J contains arbitrarily long runs, i.e. VA^, 3k 
s.t. {k,k + l,...,k + N} C J. 

Theorem 5.1. [StTr] T is weak-mixing iff^A G (3 there exists J full 
such that 

lim ii{T-''A n A) = ii{Af 

Proof. First we claim that T is ergodic. Suppose T~^{A) = A mod 0. 
By invariance we have fi{T~'^A H A) = fi{A), but by mixing along full 
sequences this quantity converges to fi{A)^ for n E J. Thus f^{A) = 
or fi{A) = 1. 

Now we are ready to prove that T is weak-mixing. Suppose not, then 
there exists a Kronecker factor {X, (3, fi, T), i.e. a rotation T on a com- 
pact Abelian group X such that the following diagram commutes: 

X-^X 



X-^X 

Fix A G /3 such that < fii^A) < 1 and let A := ti'^{A). 

Then since T is a rotation, there is a quasi-periodic sequence rii such 
that /i(f n i) ^ and thus 

/i(T-"'A n A) = /i(f -"'i n i) ^ fi{A) = n{A) 

which contradicts fullness. □ 
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5.2. Hyperbolic billiards. Instead of approximating a smooth table 
by polygons we approximate by certain hyperbolic tables. Namely 
consider a polygon P. Replace each vertex with a (small) circular 
arc such that 1) the resulting table is and 2) the focusing circles 
lie inside the table. We call such tables B-tables and if the original 
polygon is convex then CT-tables. 

Theorem 5.2. (Bunimovich |Bun] ) For any B-tables each ergodic com- 
ponent is open (mod 0) and the billiard on each ergodic component is 
mixing, K-mixing, Bernoulli. 

Theorem 5.3. (Chernov, Troubetzkoy |ChTr] ) Any CT-table is er- 
godic, hence mixing, K-mixing, Bernoulli. 

5.3. Back to billiards. 

Theorem 5.4. |StTrj The billiard flow /map in a C^-typicalC^ billiard 
table is weak-mixing. 

Sketch of the proof: If the table is convex we approximate by bil- 
liards from the class of CT-tables introduced above. Fix a CT-table 
and a finite collection of sets. For all tables sufficiently close to the 
fixed table we can find an arbitrarily long run of times such that these 
sets approximately mix along this run. 

If the table is not convex then we do not have a nice class of ergodic 
tables like the CT-class. To prove the theorem we approximate the 
table by polygons to obtain generic ergodicity. Then we approximate 
by B-tables to get the weak-mixing. □ 

5.4. Convex tables. We can slightly improve the smoothness is the 
table is convex, or piecewise concave-convex. Let PCC be the class of 

piecewise convex-concave billiard domains. Because of the piece- 
wise monotonicity of the derivative, locally the second derivative exists 
almost everywhere. Consider the Hausdorff distance pn between the 
second derivative of the boundaries of such tables. Let B'^ be the clo- 
sure of the class of B-tables in the topology induced by the metric 
P = Ph + Pc^- 

Theorem 5.5. |StTrj Weak-mixing is typical in B"^ 

We remark that PCC C B"^ C C^ and that every table in PCC is 
C^ except at a finite number of points. Furthermore the set of strictly 
convex tables is residual in -Bco™ex5 ^^us the generic table in -Bcon^ex is 
strictly convex and weak-mixing. 
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6. Back to polygonal billiards. 

Recently Avila and Forni have shown that a.e. interval exchange not 
of rotation type is weak- mixing [AvFoj . Furthermore, for almost every 
translation surface they can show that the directional flow is weak- 
mixing. A priori, these results do not hold for polygonal billiards. Thus 
the results obtained by Stepin and myself stated here are conditional. 

Let WMiXc be the set of rational polygons for which at least c% of 
the ergodic components are weak-mixing. Note that the square and 
the equilateral triangle are not in WMiXc for any c > 0. The result of 
Avila-Forni gives hope that all but finitely many rational polygons are 
in WMixi. 

Theorem 6.1. |StTr] 1) If there exists c > such that WMiXc is 
dense in the set of polygons then weak-mixing is generic for polygonal 
billiards. 

2) Either there exists m such that WMixi_ is somewhere dense in the 

m 

set of polygons (and hence weak-mixing is on 2nd category for polygonal 
billiards) or UmWMix± is nowhere dense. 

m 

7. Angular recurrence and periodic billiard orbits. 

The billiard orbit of any point which begins perpendicular to a side of a 
polygon and at a later instance hits some side perpendicularly retraces 
its path infinitely often in both senses between the two perpendicular 
collisions and thus is periodic. 

7.1. History and notation. In 1991 Ruijgrok conjectured based on 
numerical evidence that for any irrational triangle almost every orbit 
which starts perpendicular to a side is twice perpendicular and thus 
periodic |Ruj . Here almost every is with respect to the length measure 
on the side. In 1992 Boshernitzan |Bolj and independently Galperin, 
Stepin and Vorobets [GaStVo] proved this conjecture for all rational 
polygons. In this case the set of non-periodic perpendicular orbits is 
a finite set. In 1995 Cipra, Kolan and Hansen proved this conjecture 
for all right triangles |CiHaKo] . Apparently these four articles are 
completely independent of each other. 

Applying Theorem 13.41 I obtained the first approximation result in this 
direction. 

Theorem 7.1. |Tr2j The conjecture is true for dense Gs of n-gons 
with n — 2 angles fixed rational multiples of tt. 

Billiards are not affected by similarity, thus it is convenient to fix two 
corners, say at the origin and the point (1,0). For triangles if we fix 
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one angle to be a rational multiple of vr then the set of triangles is an 
interval parametrized by one of the other angles. This theorem says 
that for a dense Gs subset of (any compact subset of) this interval the 
conjecture is true. 

To discuss our results on billiards in parallelograms we must introduce 
some more notation. For the moment we assume that P is convex. We 
will describe the billiard map T as a transformation of the set X of rays 
which intersect P. Let 9 be the angle between the billiard trajectory 
and the positive x-axis. Consider the perpendicular cross section Xq 
to the set of rays whose angle is 9. The set Xq is simply an interval. 
Let w be the arc-length on Xq. 

For a non-convex polygon we must differentiate the portion of rays 
which enter and leave the polygon several times. The above construc- 
tion can be done locally, yielding the set Xq which consists of a finite 
union of intervals. Let w be the unnormalized length measure on Xg. 

For every direction 9 let Fq be the set of x G whose forward orbit 
never returns parallel to x. A polygon is called angularly recurrent if 
for every direction 9 we have w^Fq) = 0. Angularly recurrent polygons 
satisfy the conclusion of Ruijgrok's conjecture, almost every perpen- 
dicular orbit is periodic! There is no reason to think that a polygon 
chosen at random should be angularly recurrent, this property is much 
stronger than Poincare recurrence which only implies that almost every 
point comes back close to itself (angles close not equal!). 

A polygon P is called a generalized parallelogram if all sides of P are 
parallel to two fixed vectors. Note that a right triangle unfolds to a 
rhombus and thus results for generalized parallelograms hold also for 
right triangles. 

In 1996 Gutkin and I generalizing the result of Cipra, Kolan and Hansen 
proved that all right triangles and all generalized parallelograms are 
angularly recurrent jGuTrj . 

7.2. Dimensions. Let Y C R". Let N{e) denote the minimal number 
of e balls needed to cover Y. The lower box dimension of Y, denoted 
by dim LB Y is given by 

e^o logl/e 

The upper box dimension dimuB is defined similarly, replacing the 
liminf by limsup. If dimusY and dimLsY both exist and are equal, 
we define the box dimension of Y to be this value, and write dim^y 
= dimuB y = dimLB Y- 
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Let s G [0, oo]. The s- dimensional Haus dor jf measure T-C^ (Y) of a subset 
Y of R" is defined by the following limit of covering sums: 

oo 

n'{Y) = lim(inf{^ ( diam Uif : 

i=l 

oo 

F C f/j and sup diam Ui < e}). 

1=1 

It is easy to see that there exists a unique sq = so(Y) such that 
TC^{Y) = oo for s < So and for s > sq . 

The number sq is called the Hausdorff dimension of Y and is denoted 
by dim.H Y . Standard arguments give that 

dmiH Y < dimiB Y < dmiuB Y 

7.3. Approximation questions. With Jorg Schmeling we showed 
that for all generalized parallelograms dimLsiFe) < 1/2 for all 9 [ScTrj . 

The following theorem shows that we can do better that 1/2 for well 
approximable directions in a given parallelogram or for all directions 
in a parallelogram with well approximable angle. 

Theorem 7.2. |ScTrj Fix a generalized parallelogram with irrational 
angle a. For any 9 such that \\{9 + pQ;)/7r|| < has infinitely many 
solutions p G N. Then 

^mvLB{FenUe) < . 

/i + 1 

Similarly (imiLB{,Fo fl Dq) < provided the angle 9 — a/2 is ji-well 
approximable. 

Two questions naturally arise, for a fixed generalized parallelogram how 
many directions have small Fq and for a fixed direction 9q how many 
parallelograms have a small Fg^ ? 

Our answer to these question required new and recent results in dio- 
phantine approximation. 

7.4. New number theoretic results. For /i > 1 and u; G let 

-^/x,a; := {t G S"*" : \\t + puj\\ < p^^ for infinitely many p G N}. 

Minkowski's classical theorem states that if /i = 1 then Afj,^uj consists 
of all t G S"*" such that t is not in the orbit of uj. 

Using different techniques Schmeling and I and independently Y. Bugeaud 
have shown: 
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Theorem 7.3. |ScTrj . jBu] For any > 1 we have 

For /i > 1 and t E let 

Bfj_^t '■= {tu G S"*" : \\t + puj\\ < p"^ for infinitely many p E N}. 

The other result we need to apply is a recent one of Levesly: 

Theorem 7.4. (Levesly |Lej ) For any fi > 1 we have 

2 

Remark: this is a classical theorem of Jarnik for t = 0. 

Besides the applications to billiards these results can be used to ana- 
lyze the rotation driven dynamical variant of the classical Dvoretzky 
covering of the circle |FaSc ]. More recently we have studied dynamical 
diophantine approximation for the circle doubling map [FaScTr] . 

7.5. Application to billiards. We reply to the first question, for a 
fixed generalized parallelogram how many directions have small Fg7 
Let 

Cs:={e: dimLB{FenUe) < s}. 
Theorem 7.5. For all s E [0, 1/2] 

dim/^(CJ > . 

1 — s 

The set Cg is residual with box dimension 1. 

Proof. This follows immediately from Theorems 17.21 and 17.31 □ 

We turn to the second question, for a fixed direction 6*0 how many 
parallelograms have a small Fg^l Let 

Vs := {a G : dimiBiFe^, H f/^o) < s for all 

generalized parallelograms with angle a}. 

Theorem 7.6. |ScTrj For 9q fixed and s E [0, 1/2] we have 

dimH'Ds > 2s. 

The set is residual and has box dimension 1. 



Proof. This follows immediately from Theorems 17.21 and 17.41 □ 
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